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PREFACE 



This manual *cd to accompany school reports for a district. There is an 

interpretation manual for each of the three levels of schools assessed: elementary, intermediate 
and secondary. The manuals are not intended to stand alone; they are aids to school administrators 
and other staff members for understanding the reports of their respective schools. 

Two other HQA publications complement the information contained in this manual: 

1. The First Six Years gives a more general background of assessment in 
Pennsylvania-what it is and is not and additional information on EQA's evolution. 

2. Getting Inside the EQA Inventory delves more deeply into the rationale, 
development and characteristics (reliability, validity, factor analyses) of the 
instmments (tests and questionnaires) used to measure the Ten Goals of Quality 
Education. 

With these three publications and a school report in hand, the reader should have all 
the necessary tools to understand and interpret a school report. (A sample, but real, school report 
with marginal notations is replicated on the color pages of this manual.) Together, they enable 
one to become thoroughly acquainted with the 10 goals, how they are measured and reported 
for each school, what the condition variables arc, and what scores on these variables mean. 

Once the interpreter becomes familiar with these documents and has the task of 
explaining an EQA school report to another audience, an additional document-^Q/l; Publicity 
Suggest ions-mtiy prove useful. 



BACKGROUND 



Hducational Quality Assessment operates under a 1963 legislative mandate (Act 299) 
that required the State Board of Education to: 

develop or cause to be developed an evaluation 
procedure designed to measure objectively the 
adequacy and efficiency of the educational programs 
offered by the public schools of the 
Commonwealth..... The evaluation procedure shall be 
so constructed and developed as to provide each 
school district with relevant comparative data to 
enable directors and administrators to more readily 
appraise the educational performance and to 
effectuate without delay the strengthening of the 
district's educational program.... 

Although EQA has been operational in 300 of the Commonwealth's 505 school districts 
from 1970 to 1973, it begins a new mode of operation with the 1974 assessment of schools. 
The changes are of three types: 

1. No longer does the program function on a voluntary basis. For the first three 
school years, because of limited resources, participation was on a first-come, 
first-served basis. At its November 1973 meeting, the State Board of Education 
established a timetable to enforce the mandate statewide. Its unanimously adopted 
resolution states: 

During the school years 1973-74, 1974-75 and 
1975-76, the Department of Education will use the 
Educational Quality Assessment procedure to 
evaluate the effectiveness of the educational programs 
for all Commonwealth school districts based upon the 
Ten Goals of Quality Education adopted by the State 
Board of Education. Public schools housing 
approximately one-third of the students enrolled in 
each of the three grades 5, 8 and 1 1 will be included 
in the assessment each year 

2. The above resolution points up the second change: the addition of grade 8 to 
the assessment previously available for grades 5 and 11. Moreover, the three-year 
cycle will involve, three years hence, 8th graders and I Ith graders previously tested 
at grades 5 and 8 respectively. 

3. New assessment instruments have been developed as a result of three years of 
experience at grades 5 and IK A 1973 assessment of grade 7 (in selected middle 
schools) and of grade 9 (in junior high schools) provided the basis for the current 
grade 8 package used in intermediate schools. 
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PARTICIPATING SCHOOLS 



The voluntary feature of participation was not completely eliminated in March 1974. 
In September 1973, Secretary Pittenger notified all superintendents of the availability of assessment 
for the 1973-74 school year and cited the pending State Board action to mandate participation 
by one-third of the districts each year. 

The basis for selecting applications from those solicited was to obtain a previously 
designed representative sample of the staters school districts. The criteria for representativeness 
were number of students in the district and wealth as determined by the aid ratio. Further 
consideration was given to achieving geographic balance and accommodating districts whose 
applications had been rejected in previous years. 

After some last-minute changes and substitutions, applications from 170 districts were 
accepted. The districts contained: 

No. Schools No. Students 

51,342 
53,326 

48,276 
152,944 

From these 170 districts, a normative sample of schools was chosen. The emphasis here 
Is on schools, since they are the unit of analysis. A report is compiled for a school-not a student, 
not a classroom, not a district. 

The following were selected as norm schools: 

No. Schools No. Students No. Teachers 

Grade 5 354 25,209 5,489 

Grade 8 236 51,685 8,553 

Grade 11 189 47,043 9.273 



Grade 5 


785 


Grade 8 


240 


Grade 11 


191 


Total 


1,216 



The selection of norm schools was geared to eliminate bias by (1) excluding 
unrepresentative schools such as college laboratory schools and (2) eliminating oversampling of 
schools within any one district. 



NATURE OF THE QUESTIONNAIRES 



The Pennsylvania Student Questionnaires measure, by aggregating student scores, a 
schools status on the Ten Goals of Quality Education. 

PENNSYLVANIA'S TEN GOALS OF QUALITY EDUCATION 

Quality education should: 

I Help every child acquire the greatest possible understandmg of himself or herself 
and appreciation of his or her worthiness as a member of society. 

II Help every child acquire understanding and appreciation of persons belonging to 
other social, cultural and ethnic groups. 

III Help every child acquire, to the fullest possible extent, mastery of the basic skills 
in the use of words and numbers. 

IV Help every child acquire a positive attitude toward the learning process. 

V Help every child acquire the habits and attitudes associated with responsible 
citizenship. 

VI Help every child acquire good health habits and an understanding of the conditions 
necessary for maintaining of physical and emotional weO-being. 

VII Give every child opportunity and encouragement to be creative in one or more 
fields of endeavor. 

IX Help every child to understand and appreciate as much as possible of human 
achievement in the natural sciences, the social sciences and the humanities and 
the arts. 

X Help every child to prepare for a world of rapid change and unforeseeable demands 
in which continuing education throughout adult life should be a normal expectation. 

These comprehensive goals, adopted in 1965, were reaffirmed by the State Board of 
Education in January 1974. 

Each goal statement, stated above in its entirety, is given a name for brevity's sake. 
For example, in the school report Cfoal V is referred to as Citizenship. But citizenship means 
different things to different people. Thus, to interpret what a school's Goal V score means, one 
needs to know the underlying rationale of the citizenship instrument and what areas are covered. 

Table 1 contains a summary of the instruments with names for the areas covered for 
each goal, a description of the subscales, the number of items and a sample item for each subscale. 

For the cognitive measures, the theoretical maximum score for a student is equal to 
the number of items for that goal and the theoretical minimum is zero. Therefore, for the basic 
skills measures, both cognitive, the theoretical score range is 0*30. 
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TABLE 2 



CORRELATION COEFFICIENTS 
AMONG SCHOOL GOAL SCORES 
GRADE 8, ^^=236 



II III-V III-M IV V VI VII VIII-K IX 



I 






















II 


30 




















III-V 


32 


27 


















III-M 


27 


28 


92 
















IV 


a 


33 


09 


06 














V 


-04 


30 


09 


09 


56 












VI 


22 


39 


25 


25 


58 


72 










VII 


20 


-05 


-33 


-32 


-03 


-20 


-30 








VIII-K 


35 


27 


90 


87 


11 


07 


30 


-43 






IX 


43 


55 


28 


24 


67 


48 


55 


-05 


30 




X 


40 


33 


-05 


-06 


65 


48 


54 


05 


00 


52 



NOTE: All correlation coefficients have been rounded to two decimal places 
and the leading decimal points have been omitted* 



|rl > 0.13 is significant at the .05 level 
/r| > 0.17 is significant at the .01 level 
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PERCENTILE RANK BY GOAL 



Of the four kinds of information in a school report, perhaps the most attention is 
given to the school's percentile rank in the state. 

The rank on each goal is determined by comparing the school score to the scores of 
a representative group of 354 normative schools. 

Table 3 graphically represents the normative method of scoring by showing, at 
five-percentile intervals, how the raw score averages for a school translate to percentiles. Fv.r 
example, Upper Penn Elementary School's score of 78.16 on Goal I places the school at the 
60th percentile, which means that 60 per cent of the schools statewide had lower school scores 
on this goal. 



The reader may note the small score difference between a 60th percentile score and 
65th percentile score. This occurs because of the limited range of school means. In a given school 
student scores on, say. Goal III-M may range from 2 to 28, whereas the school mean, or average, 
score might be 15.31. This is true in each school, as illustrated by the frequency distribution 
below. 
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12 14 16 18 20 
Raw Score (No. Items Correct) 

Figure 1: Comparative Distributions of Student Scores 
and School Scores on Goal HUM. Grade 8 



26 



28 30 



Sc 



The range of student scores in the state is from 2 to 30, but school scores (means of student 
scores in each school) are concentrated between 12 and 18. Therefore, raising a school score 
from 15 to 16 means bypassing possibly 30 per cent of the schools in the state. 
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PREDICTED SCORE RANGE 



One objection frequently raised to normative scoring methodology^ as illustrated by 
percentile rank in the state, is that it fails to incorporate the widely divergent operating conditions 
of various schools. In a state as large and heterogeneous as Pennsylvania, one can easily think 
of the vastly different resources-physical facilities, financial resources, teachers and, possibly most 
importantly, the home conditions which influence the students entering a school-under which 
schools operate. The Commonwealth contains such disparate school communities as rural-farming 
areas, coal-mining areas, big cities, small towns, affluent suburbs, working-class suburbs, to name 
a few. 

These diversified conditions place limitations-some deterministic in nature, others 
amenable to change-upon what a school can expect in the way of student performance. In physics, 
one talks about efficiency in terms of output relative to input. Similarly for schools, output 
(student performance) can be viewed relative to input (school conditions). 

The Pennsylvania assessment model does just this. Data are collected on school conditions 
(see following section on C^ONDITION VARIABLES) which, educators and researchers contend, 
place restraints on what a school can accomplish with its pupils. 

Correlation coefficients are then computed between these quantified school conditions 
and the goal scores for the schools (see Table 9), Some of the hypothesized relationships hold 
up. others do not. From this set of potential predictors, those school conditions which statewide 
relate most highly to a given goal can be used to calculate (predict) a score range for a school. 

The predicted score range docs not involve ;j value judgment aboyt the school. It is 
based upon the knowledge that other schools in the state, when operating under a similar set 
of conditions, tend to score in this range. 

This methodology allows one to make a second comparison of the school scores: Are 
\vv within our prediction hand,, above in any goal areas, or below in any areas? Another way 
of viewing this cjuestion is: /;/ Goal Y how are wc doing compared to schools operating under 
a similar set of conditians, or schools with resources similar to ours? 
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CONDITION VARIABLES 



Rationale 

The previous section, Frediacd Score Range, stated that to ameliorate the possibly 
invidious comparisons that percentile ranks alone invite, the Pennsylvania assessment model also 
includes an input-output component. 

Schools around the state have vastly differing resources at their disposal. The differences 
are not only in the students served but also in teaching staff and financial and parental support. 

Measurement 

Tables 4 and 5 describe the 32 variables which were collected to identify the differences 
in resources among elementary schools. The variables came primarily from students (as part of 
their questionnaires) and teachers (Appendix A-Teacher Questionnaire). 

It is extremely important to note how the variable was measured and quantified. Higli 
scores for a school on these variables arc not necessarily good. The numbers attached to these 
variables are designed to reflect the presence or absence of the characteristic in question (e.g., 
per cent female teachers) or to differentiate by quantification one class within the characteristic 
from another (e.g., teacher locale where highest weights are assigned to outsiders). 

Percentile Rank 

For each of the 32 condition variables the school receives its percentile rank compared 
to the state normative sample of 236 schools. This information is provided so that one can tell 
not only wluit conditions or resources a school has but also its relative conditions. A high percentile 
likewise does uot necessarily imply good conditions. 

Tlie norms charts (Tables 6 and 7) for the two groupings of variables give a more 
graphic representation of the percentile rank scores in the school report. They illustrate also how 
much schools differ on a particular variable. Because they are distributions of school means, the 
ranges of values at times can be very narrow, so that a small increase in a school mean value 
may translate into a large percentile rank change, e.g., stable (stability of student residence). 

Statewide Item Results 

In the school report the condition variables are stated as a school score. In most cases, 
interpreting a school score is simple and straightforward. For instance, to say that the average 
class size is 27.9 seems understandable enough. But many variables are scaled in such a way 
that the mean score, which becomes the school score, disguises much of the information used 
in its calculation. 

As a result, percentage replies by item are included in the school report for some variables 
obtained from the students and teachers. Although the percentages for a particular school are 
by themselves meaningful, an additional comparison of these percentages to the statewide figures 
might amplify the picture for the interpreter. Table 8 includes the statewide percentages of those 
variables for which item data are included on pages 4-7 of the school report. 
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Correlation Matrices 



Tabic 9 shows the relationship between a given condition variable and school scores 
on the 10 goals. Here again the reader is warned against constructing a cause-effect relationship 
from a correlation. 

Table 10, which shows the intercorrelation among the condition variables themselves, 
although open to the same warning as above, suggests one of the reasons why cause-effect 
relationships are so dangerous. No variable exists in isolation; many interrelationships exist. The 
staff-pupil ratio, if changed, would alter the instructional expense per pupil and may change any 
number of teacher variables (experience, perception of learning atmosphere, classroom practices, 
etc.). 
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TABUE4 

PROM ADMINISTRATORS, DEPARTMENT RECORDS AND TEACHERS 



VARIABLE AND 


MEASURE 


WEIGHTING 


INDEX DESCRIPTION 


CRENROLL 
(Grod* •nroilm«nt) 


Th« school odminittrotor 
r«port«d •nroilm«nt of th« grod* 
undtr contjd«rotion. 


Actuol nMmjber of etud«nts in the 
porticipoting grode. 


A higher value indlcotes o lorgor 
grode enrollment* 


PCTATTEN 
(P«rc*nfa9« ott«n3onc«) 


Th« school odministrotor 
r«port«d th« ott«ndonc« doto for 
ih« grod* und«r contid«rotion. 


Expressed to neorest tenth of o 
per cent* 


A higher value indieot«s o higher 
ott«ndonce rote. 


INSEXADM 
(Initrwctionol •xptnsct p«r 
ovttfogv doily m«i«b«rthifi) 


Th« initructionol •xp«nt«s of 
th« secondory progrom w«r« 
divided by the Averoge Doily 
Membership of the elementory 

schools. 


Expressed In neorest whole 
dollor for 1972.73. 


A higher value indicot«s that the 
district exponds relotively more 
funds per student for secondory 
instruction. 


TLOCALE 
(T«ach«r loco!*) 


The teoch*rt reported where they 
spent most of their lives. 


2 = More thon 100 miles from 
boundories of this school 
district 

1 =More thon 30 miles but less 

thon 100 miles 
0 = In or within X miles 


A higher value indieot«s thot the 
school teoching ttoff i< drown 
from more distortt oreot. 


TSATPAR 
TSATFS 
T SAT ST 
(T*och«r totiifoction with 
t«lottonshipft wjlh:) 
\) pQrfxtt 

2) Stoff 

3) Students 


The teochecs reported how satis- 
fied they were with their 
reiotionship with' 

Porentft ond porent groups 

Fellow stoff members 

Students 


3 = Very sotisfi ed 
2 = Somewhot sotisfied 
1 = Somewhot dissottsfied 
0 = Very dissatisfied 


A higher value on ony of these 
indicies indicot«s thot the 
teaching stoff of the school is 
more sotisfied with its retotion* 
ships with the group. 


TCLATT 
(Attitud* toword 
clossropifi l#o cKt hq) 


The teocherft reported if they 
•n|oy closftroom teoching. 


4 = Almost olwoys true 

3 = Usuolly true 

2 — Sometimes true 

1 = Seldom true 

0 = Almost never true 


A higher value indicates thot 
teoching stoff more often entoy 

w 1 u • 9i y ovfi ivy wfi i hb ^ 


PERSAD 
(Tcach*r p*rc«ption of 
school odminifttrotion) 


The teocherft responded to 6 
items concerning their feelings 
obout the school odmmi strotion. 


4 = Always true 
3 = Usuolly tru« 
2 = Sometimes true 
1 Seldom true 
0 ^ Never true 

Ronge: 0-24 


A higher value on this index 
indicates o more positr.e 
attitude of the school'^ teoching 
• lOTT lowora ine scnool 
odministrotion. 


PERDAD 
(T«och«r p«rc*ption of 

district odmini fttrotion) 


The teochers responded to 3 
I'ems concerning their feelings 

about the district odmini strotion. 


4 ~ Alwoys true 
3 ~ Usuolly true 
2 ^ Sometimes true 
1 = Seldom true 
0 ~ Never true 

Range: 0-12 


A higher value on this index 
indicotes o more positive 
ottitude of the school's teaching 
stoff towards the district 
administration. 


CLPRACT 
(Closftroom proctic*ft) 


The »eoch*rS reported the extent 
to which they used 11 ctossroom 
proctices judged to be innovotive 
(e.g., pupil porticipotion in 
lesson plonning). 


3 = 1 use it doily 

2 " 1 ute it weekly 

1 =1 use It monthly 
0 ^ 1 do not use it 

Range: 0-33 


A higher value indicotes the 
teaching stoff report more fre- 
quent usoge of these practices. 


PERLERAT 
(T«och«r perception of 
looming otmoftph«r») 


The teoch*rs mdicoted whether 
eoch of 13 school problems con- 
ttitured 0 problem in their 

school. 


1 = No 
0 = Yes 

Ronge: O'-H 


A higher volue tndtcotes o 
positive learning otmosphere, 
that reochers feel fewor of the 
listed problems affect their 
school. 
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TABL£ 4 (Cortmued) 



P^KOM ADMINISTRATORS. DEPARTMENT RECORDS. AND TEACHERS (Continued) 



VARIABLE AND 
COMPUTER CODE 


MEASURE 


WEIGHTING 


INDEX DESCRIPTION 


TPERPAR 
(T«cichtr p«rc«ptioii 
of por«ntt) 


Ths tMchsrs indicotsd w^sth«r 
•Qch of 5 conditiofts rstotsd to 
porontol Qttituds constitutsd o 
problem in thsir school* 


1 = No 
0 = Ys$ 

Kongo: v*j 


A highor voluo indicoto* o 
posttivo ottituds on >ho port of 
ths tsochor toward the porsnts 
and homo. 


TPEP 
•nvironm«ntol prtss) 


Ths t«och«rs rsspondsd to 8 
itsms rogordifVQ tholr fsolinQS 
obout thsir solf*os»urodno$t>< 


Almost olwoys trus of ms 
Ofton trus of ms 
Somotimss trus of ms 
Ssldom truo of mo 
Almost novor truo of ms 

Rongo: P*32 


A highor voluo indicotos thot 
tho toochsrs ofs rslotivoly moro 
sslf*assursd> 


PCTFEM 
(P#r C9nt 
(•mol* t«och*rs) 


Tho toochors indicotsd thoir 
ssx. 


Exprsstod in porcontogo. 


A highor volus mdicotos thot 
tho school has o hi^hsr 
psrcontogs of fomolo teochsrs. 


TEDUC 
(TMch«r •4^cotlon) 


Ths toachors indicotod ths Isvsl 
of formol oducotion thty hovs 


4 = Doclor^s dogrss 

3 = Mostor' s dogroo plus 1 ysor 

oquivoloncy 
I = Bochslor't dogrss 
0 = No dsgroo 


A highor voluc indicotes thot 
tho school's instructional staff 
rsportsd o highor lovsl of format 
oducation. 


V 1 r r 

(T^ochvf to 

pvpii rotio) 


Ths toochors rsportsd thoir 
ovsrogs closs sixs oxcluding 
suporvisory dutiss such os 
study holl. 


Exprsstsd OS 0 toochsr to 

pupil ratio. 


Tho psrcontilo ronk indicotos 
tho por csnt of schools with o 
grsotsr ovsrogs class sixo. 


(T«och*r hours of 
instruction psr wsok) 


Tho toochors rsportsd ths nUmbor 
of clock hours thoy ors ossignod 
to classroom instruction psr wosk. 
wssk. 


Exprostsd OS ovsrogs hours 
psr wook 


A highor volus indicotos thot 
ths toochors of tho school sptnd 
rolotivoly more hours in ths 
classroom. 


TEXPER 
(T*och*f sxptri tries) 


Ths toochors rsportsd ths totol 
ysars of sorvics in sducotion 
including curront school yoor. 


Exprsstsd OS ovsrogs years' 
sxporioncs. 


A highor voluo indicotos thot 
ths toochsrs of ths school hovo 
rslotivoly moro years of tooching 
ox^srioncs. 


PREPERDY^ 
(Number of tsochor 
propofotions psr day) 


Ths toochofO roportsd tho 
numbor of dlHoront coursss, on 
ths ovsrogs, thoy tooeh psr doy. 


Exprssssd OS ovorogo numbsr 
of proporotions por day. 


A highor voluo indicotvs thot 
ths tsochsrs hovs relotively moro 
proporotions per day« 



1 



Crods 1 1 only 



erJc 
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TABLE 5 

FROM STUDENTS 



VARIABLE AND 

v^UMrUICK ^UUC 




WPIGHTINC; 
"CI vn 1 1 r^ V 




FOCC 
(Foth«r* % occupotion) 


Tha itudantt raportod th« occu* 
potion most tikathair fothart or 
mala guardians found on a li tt of 
i45 passibU ocoupationt ond 6 
•pacia! cofagorits. 


Tht occupationol cottgorits wtrt 
waightod from \ to 96 occording 
to 0 combination of tducotion 
natded to sacurt tht occupotion 
end income dtrivad from tht 
occupotion. 


A hightr volua indicotat rtiot 
tha school ttnds to draw o lorga 
proportion of Its studants from 
homts whtrt tht fothtrs ora 
amploytd in hightr-poy ing |obs 
rtquiring o hightr oducotionol 
ttvtl. 


ocdesire' 

(Occupational dtiir*) 


From tha list of 145 occupotioni 
mtntionod obovt, tht itudtnts 
raporltd tht occupations most 
likt thost thay wish to follow 
whan finishod in school. 


Samt wtighting ustd in FOCC 
obovt 


A hightr volua indicotts thot 
tht studtnts dtsirt to ottoin 
hightr paying |obs rtquiring o 
hightr tducotionol Itvel. 


1 

OCEXPECT 
(Occupotianal axp«ctation) 


From tha lilt of 145 occup<)tions 
tht studonts rtportad tht occu- 
pations most likt thost thty 
rtolly txptct to follow whtn 
finishad in school. 


Samt wtighting ustd in FOCC 
obovt. 


A highar volua indicotts thot 
tht studtnts txptct to ottoin 
hightr poymg jobs rtquiring 
0 highai tducotionol Itvtl. 


PCTGIRLS 
(P*r c«nt QirU) 


Tht ttudtnts indicottd thtir >tx. 


Exprtsstd in ptrcantogt. 


A hightr volut indicotts thot 
tht school hos 0 gieottr propor, 
tion of girls in tht grode lavtl. 


MEDUC 
(Mothar't •ducotion) 


Tht studtnts rtporttd tht hightst 
lavtl of formal tducotton ottaintd 
by thair mofhtrs or fttnola 

ouorA 1 on % m 


8 = Ph<0* or proftssionol dtgrtt 
7 - Somt work toword Ph«0* or 

proftssional dtgrot 
6 = Ma star's dtgrot 
5 = Bachtlor' s dtgrat 
4 = Somt colltgt, vocotionol, 
ttchnicol, busintss tchooi 
ofttr high school 
3 = High sdiool groduott 
2 = Somt high school, but not 

0 groduott 
1 = Complttad grada school 
0 = Nont or somt grodt school 


A highar volut mdicotes thot 
tht school drows studtnts from 
homos in which tht mo<htrs hovt 
ottointd 0 highei ovtrogt Itvel 
of formol tducotion 


RESIDE 
(Typ« of community) 


Tht studtnts with tht oid of tht 
monitor rtporttd tht typt of 
communiiits In which thty wart 
thtn living. 


7 - In Philodtlphio or Pittsburgh 
6 Insidt 0 lorga city (100.000 

to 500,000 ptopit). 
5 = Insidt a mtdium sitt city 

(10.000 to 100.000) 
4 = In 0 suburb of Philodtlphio 

or Pittsburgh 
3 *- In 0 Suburb of a lorgt city 
2 = In 0 (uburb of o mtdium 

sizt city 

1 • 1 111 it m »L — 

1 = In 0 small town (less than 

10.000 ptopIt) 
0 = In tht optn country or in o 

forming community 


A hightr volue indicotts tha* 
tht studtnts residt in iorgtr 
oreos of dtnjo populotion. ut.^ 
mort removed from open spoce. 


PCTWMITE 
(Par cant whita studonts) 


Tht studtnts rtporttd thtir 
roct. 


Ejcprosscd in ptrcantogt. 


A hightt volut mdicotes thot 
tht school hos 0 grooter propor* 
tion of white »tudtnt s in th^ 
grode ltvtl> 


LIBRARY 
(Accassibllity of librory) 


Tht studtntit rtporttd how oft»n 
thty wart obit to u*t tha school 
librory. 


4 - As ofttn OS 1 nttd to 

3 = Frtqutntly. but not os ofttn 

OS 1 would likt to 
2- Only two or thrte doys o 

wetk 

1 = Only wKtn my clots is 

schtdultd for librory work 
0 r. No librory in school 


A higher score indiCOt«s thot 
tht students report grtoter 
occessibility of the librory. 



Grodt 11 only 
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BEST COPY AVAflABUE tables 

FROM STUOINTS (Continued) 



VARiABte AND 

COMPUTER CODE 


MEASURE 


WEIOHTINC 


iNDhK OtSCRIPTION 


(Acc«ssiktlity 

of counMlor) 


Th« studtntt rtporttd haw oh»n 
th«y w*r« obU to talk to th« 
school guidonct cowns*lar about 
a concern* 


4 ^ Whonever 1 need to 

3 = Often, but not as fraquently 

ds i would like to 
2 = Oily ^ort moking out o 

CI Ol • •CnOQUiV 

1 ' Only m group guidonce session 
0 = No guidance counselor 


A higlior volue indicotes thot 
the students report freer access 
to the guidonce stoff. 


STABLE 
(Stobifity of 
Student rttidtnc*) 


Th« studtnt r»fort*d th« numb«r 
of di(ftr«nt school buildings 
ott9nd«d within th« post 3y«ars 
b«cous« family changtd 
rastdtnca* 


4 = My family hts not moved 

within the past 3 years 
3 = 2 school buildings 
2^3 school buildings 
1 ' 4 schoal buildings 

0 Z S <#>knAl Wjllfli'<«aB 

V — ^ «cnoQi wu'misi^w 


A higher volue indicotes that 
the students come from fomilies 
which ore less mobile. 


PARATT^ 
(Por«ntot attitudt 
toword school) 


Th« itudonts roporttd thtir 
opinions on thrsa ittms: 

(1) My parents en|oy haaring 
obout School 

(2) My porants f««t th« school 
IS doing a good iob 

(3) My parantf support what 
th« sthoot dots 


3 = Almost alwoys 

2 = Usually 

1 = Someiimas 

0 = Almost novet 

Grod«8 & 11 Ranga: 0<9 
Grode 5 Range: 0*6 


A higher value indicotes thot the 
students felt then porents hove 
o ^reot interest m the school, a 
higher opinion of tho work of the 
school, and greater Support of 
the school. 


MORESB^ 
(Morvt • Boyt) 


Th« students roportod tHoir 
pareoption of th« singia bait woy 
for 0 boy ta gat to ba importont 
and laokad up to by othar 
students. 


6 = Being bright and welUtnfarmed 
5 = Doing wall in school 
4 = Being o leader in school 

octrvities 
3 = Being fun to be with 
2 — Being on athlatic star or 

0 cheerleadsr 
1 = Being good*looking 
0 = Coming from tha right fomi ly 


A higher score indicotes thot 
students perceive intailectuol 
foctors OS reiotivoly mora 
important thon sociol foctort or 
athletics <n detarmming o boy's 
popul arity* 


2 

V/ r\ w «iw 

(Mortt • Girls) 


Tha students roportad thair 
parcaption of the single best wtfy 
for 0 girl to gat to be important 
and lookod up to by othor 
ttudentt. 


Soma as for MORESB oboveT 


A highar scora indicotei the 
students percatvs intelieciuot 
factors OS relotiv<»ly moie 
importont thon $oc<ol fccior> in 
determining o girl's populonty 


VALUES^ 
(Ptrtonol voluvs) 


Tha studontt reported tha 

quolity which woi most importont 
to thtm OS individuals ragordlass 
of whot others moy choosa. 


Same o» for MORESB above. 


A highar score indicotes ihot 
studants perceive mietlociuol 
pursuits OS hoving moro petsonol 
volue thon socio! status factors 


HOMECUM 
(Horn* cllmot«) 


Tha studants raported thair 
opinions on 8 items obout homo 
conditions. 


Vary much tike me 
Usuolly hke mo 
Usually unliko me 
Vary much unlike mo 

Ronge: 0*24 


A highar votuo mdicotos thot the 
students hove more favoroble 
ottitudcs toward their home 
conditions. 



Grodo 8 and U only 

Only the first two items woro usad for grada 5. 
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TABLES 

STATEWIDE ITEM REPLIES FOR SELECTED CONDITION VARIABLES 



TSATPAR, TSATFS, TSATST 
In your teaching situation, how satisfied are you with your relationship with: 



Very Somewhat Somewhat Very 

Dissatisfied Dissatisfied Satisfied Satisfied 



Parents and parent groups 
Fellow staff members 
Students 



5% 
7$ 
3% 



19% 
13% 



5X% 



25% 
53% 
35% 



I enjoy classroom teaching. 
Almost never true 
Seldom true 
Sometimes time 
Usually true 
Almost edways true 



TCLATT 

056 
156 
856 
U56 
4656 



CLPRACT 





Not 
Used 


Each 
Month 


Each 
Week 


Each 
Day 


Pupil participation in lesson planning 


3&% 


2656 


2056 


15? 


Pupil participation in classroom teaching 


19% 


29% 


2356 


2956 


Having pupils work in small learning teams 


U% 


31% 


3056 


2556 


Bole playing (acting out situations) 


50% 


31% 


U56 


556 


Use of games to aid learning 


23% 


Al% 


2756 


956 


Ripil evaluation of classroom climate 


39% 


39% 


U56 


8% 
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TABLE 8 (Continued) 
CLPRACT (Continued) 





Not 


Each 


Each 


Each 




TTqaH 


Month 


Vi6eiv 














Involving pupils in community projects 


62% 


29% 


(>% 


3% 


Utilizing local citizens as resource personnel 


61% 


33% 


h% 


1% 


Pupils as helpers or tutors of other pupils 


13% 


26% 


30% 


31% 


Joint lesson planning with one or more teachers 


UB% 


26% 


15% 


10% 



PERLERAT 

Survey of school problems: (per cent = yes responses) 

There is too much teacher turnover x^% 

The classes are too large for effective teaching 62% 

The different races or ethnic groups don't get along together 11% 

There are too many interruptioris during class periods 3J^% 

Teachers have too little freedom in such matters as textbook 

selection and curriculum 22% 

There is too much competition for grades 26% 

There is too much emphasis on athletics 3356 

There should be a better mixture; the students are all too 

much of one type 2I^% 

Too much time has to be spent on discipline 3656 

The students aren't really interested in learning 5756 

There is a lack of effective leadership from the school administration A0% 

The teachers don't geem to be able to work well together IJ^% 

We have poor instructional equipment: supplies, books, laboratory 

equipment, etc. 2JL% 



ERIC 
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TABLE 8 (CoMinutd) 
TPERPAR 

(Per cent = yes responses) 
There are too many absences among students Kl% 
Pupils are not well fed and/or well clothed 13$ 
Parents attempt to interfere with the school 24$ 
The parents pat too much pressure on the students for good graded 26$ 
The parents don't take enough interest in their children's schoolwork 6l$ 



RESILE 

In what type of community are you now living? 

In the open country or in a feumLng community 18$ 

In a small town (less than 10^000 people) that is not a suburb 25$ 

Inside a medium size city (10,000 to 100,000 people) 18$ 

Inside a large city (100,000 to 500,000 people) 1$ 

In Philadelphia or Pittsburgh 3$ 

In a suburb of a medium size city 13$ 

In a suburb of a large city 4$ 

In a suburb of Philadelphia or Pittsburgh 17$ 



PCTWmTE 

Which of the following best describes you? 



Black 6$ 

White 91% 

American Indian 1$ 

Oriental 0$ 

Puerto Rican 0$ 

Other IJt 
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TABLE 8 (Continued) 



LIBRARI 

How often are you able to use the school library? 

As often as I need to 54$ 

Frequently, but not as often as I would like to 1B% 

Only two or three days a week 15% 

Only when my class is scheduled for library work 125^ 

There is no libraury in this school 1% 

COUNSEL 

How often are you able to talk with your guidance counselor about a concern? 

Whenever I need to 78$ 

Often, but not as frequently as I would like to 8$ 

Only when making out a class schedule 6% 

Only during a group guidance session J% 

This school does not have a guidance covmselor 1% 



STABLE 

How many different school buildings have you attended within the past three years 
because your family changed residence? 

}fy family has not moved within the past three years 78$ 

2 school buildings 15$ 

3 school buildings 5$ 

4 school buildings 1$ 

5 or more school buildings 1% 
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TABLE 8 (Coninued) 



MORESB-MORESG—VALUES 

MORESBAJDRESG: Among the qualities listed below, what is the single best way 
for a boy/girl to get to be important and looked up to by other 
students in this school? 

VALUES Among the qualities listed below, what do you feel is most 

important to you personnally, regardless of what others may 
choose? 





HORESB 


MORESG 


VALUES 


Being bright and well informed 


10% 


8Jf 


12$ 


Doing well in school 


9% 


6$ 


2U% 


Being a leader in school activities 


13% 


8$ 


U% 


Being fun to be with 


A0% 


375t 


U5% 


Being an athletic star or cheerleader 


15% 


5% 


(>% 


Being good-looking or attractive 


10% 


33% 


5% 


Coining from the right family 


y% 


3% 


K% 
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TABUS 



CORRELATION COEFFICIENTS BETWEEN 
SCHOOL CONDITION VARIABLE SCORES AND SCHOOL GOAL SCORES 
GRADE 8, N=236 







T 
i 


TT 

X.X. 


T TT V 


T TT M 


TV 






VTT 


VTTT-K 


IT 
XA 


X 


GRENKOLL 


1 






17 


18 


-17 


-22 


-13 


13 


U 






PCTATTEN 


2 






52 


52 




29 


28 


-48 


51 


16 




INSEXAEM 


3 


25 




U 


13 




-29 


-19 


19 








TLOCALE 








15 


17 




28 








U 




TSATPAR 


5 


26 


13 


51 


49 






15 


-22 


46 


16 




TSATFS 


6 






19 


16 








-15 


17 






T3ATST 


7 


16 




37 


37 


15 


16 


13 


-15 


33 


19 




TCLATT 


8 


17 


16 


36 


35 


15 


15 




-18 


31 


19 




FSRSAD 


9 






16 


U 
















PERDAD 


10 






16 


16 










15 






CLPRACT 


11 


13 






-15 






-U 




-15 






PERLERAT 


12 






43 


40 








-25 


39 






TPERPAR 


13 


20 




46 


U 








-23 


41 






TPEP 
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NOTE: All correlation coefficients have been rounded to two decimal places and the 
leading decimal points have beer, omitted. Only |r|>0.13 are printed because: 

in > 0.13 is significant at the .05 level 
\T\> 0.17 is significant at the .01 level 
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STUDENT DISTRIBUTIONS FOR CXXJNITIVE MEASURES 



A school mean alone disguises much about student performance on a given goal. Did 
all the students score close to the school mean or were the student scores widely divergent? 
Indeed, very different student distributions could result in similar mean scores. 

Page 8 of the school report contains a distribution of student scores on the three cognitive 
measures included in the student questionnaires. 

The student scores from the normative sample were rank-ordered high to low and divided 
into five categories as nearly equal as possible. They represent the scores obtained by the top 
20 per cent of the students in the state, the next 20 per cent, down to the lowest-scoring 20 
per wnt of students. In many cases no matter which of two cut-off scores was used, slightly 
more-K)r less--than 20 per cent of the students scored above that point. Therefore, the STATE 
NORM column may contain 19, 21 or 22 per cent. 

The SCHOOL ACTUAL column shows the percentage of students in the school who 
obtained scores in that range. 
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CRITERION-REFERENCED SCORING MODEL 



Included in each school report is normative information which indicates how a school 
scored in a given goal area relative to other .schools in the state. This scoring method is common 
in testing where people, for instance, are compared to the average person-or the norm. IQ scores 
are an example of such a scoring procedure by which the average person is assigned a score 
of 100 and othen receive scores then relative to the average, 

Difllculties in Normative Scoring Procedures 

Most people know about grading on the curve-another example of normative scoring. 
Pertiaps two somewhat extreme examples will serve to show some real or hypothetical weaknesses 
in normative scoring. 



History Math 



test 




test 


70% 


A 


100% 


60 




90 


60 


B 


90 


50 




80 


50 




80 


50 




80 


50 


C 


80 


40 




70 


40 


D 


70 



30 F 60 



Consider the above two sets of numbers as the scores of a class of 10 students on 
two tests-a history test and a math test. Assume further that the same girl received an A on 
each test. She earned her A in history by answering only 70 per cent of the questions correctly, 
while her A in mathematics required her to answer all the questions correctly. Are these As 
equal? Normatively, yes. But the normative scores (A in this case) say nothing of her mastery 
of history versus that of mathematics, 

A similar situation exists with the various EQA goal instruments. Should one be content 
with, say, a 90th percentile score? How far from perfect is such a score? The following table 
of statewide scores illustrates how percentile scores, as normative information, cloud some 
information: 

Goal Y GoalZ 
— — «^ . perfect score 



,99%ile 

.50%ile •99%ile 
. l%ile 



,50%ile 
, l%ile 



zero score 
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The Pennsylvania Model of Criterion-Referenced Scoring for AttitudintI Measures 

Cotisider an item from the Goal I, Se!f*Esteem instmment: 

/ m pretty sure of myself, 

3 A Very true of me + 

2 B Mostly true of me + 

I C Mostly untrue of me 

0 D Very untrue of me 

Normative Criterion 
scoring scoring 

In the normative scoring method the degree of favorableness of a student's reply results 
in a score of 3, 2, 1 or 0. For the same item in the criterion-referenced scoring procedure, a 
dichotomized approach is used; the student response is considered either favorable (very tme 
of me, mostly true of me) or unfavorable (mostly untrue of me, very untrue of me), A criterion 
of 51 percent was established for the entire self-esteem instrument of 40 items; that is, if a 
student answers a majority of the items (21 or more) favorably, that student is said to have 
a minimum positive attitude for Goal 1. The number of such students is then tallied for the 
school and expressed as a per cent of all the students completing the inventory. So, one might 
discover that 65 per cent of the schools 5th grade students have a minimum positive attitude. 
The other side of that coin, the negative side, is: 35 per cent of the students don't answer 
even a m^ority of the items favorably. One might, accepting the 51 per cent criterion, conclude 
that 35 per cent of the students could use some help, that their self-esteem is lagging. 

The criterion-referenced information is given not only for each attitudinal goal but for 
its various subscales as well. It is a modified criterion-referenced approach in that a school is 
given not only the per cent of its students satisfying the criterion, but also the per cent of 
students statewide answering a m^ority of the items favorably. This forces one back to a normative 
type of reference. But it appears necessary, as many recipients of assessment, when told that 
65 per cent of their students have a minimum positive attitude in self-esteem, ask: So what? 
What does that mean? How does that compare with. . .? Thus a comparison to the state is 
included. 

How Criterion-Referenced Infonnation is Reported 

In the school report the per cent of students statewide with this minimum positive 
attitude on each attitudinal subscale is graphically represented by a row of S*s, the per cent 
for the local school by a row of L s. 

This infoimation should also give more specific diagnosis of strengths or weaknesses 
within a goal area by analyzing local scores vis-a-vis statewide scores. 

Furtiiermore, page 20 of the school report displays the same two rows, state and local, 
for the total scale-not just the subscales. 
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Page 21 of the report, under the SI per cent criterion cohimn, gives the exact numerical 
vaUies which aic graphically displayed on pages l(K20. Two additional criterion levels are also 
provided tf one desires a more stringent (70 per cent) or less rigorous (35 per cent) criterion. 
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APPENDICES 

ERIC 



APPENDIX A 
TEACHER QUESTIONNAIRE 



School Namt. 



.District Namt. 



INSTRUCTIONS: The information rectivad will ba amrtgtttd and raportad as rtlationshlps to studant achitvement. No 
individuals wilt b« idantifiad and no individual information will ba raporttd. Rtspond to tha items by blackening the 
appropriate space. 

EXAMPLE. Are you a classroom teacher? Yes# NoQ USE A NO. 2 PENCIL ONLY. 

TIOCALE 

Where have you spent most of your lift? 

In ot within 30 miles of the boundaries of this school district , O 

More thjn 30 miles but less than 100 miles from the present t)oundaries of this school district O 

More than 10O miles from the boundaries of this school district O 



In your teaching situation how satisfied are you with 
your relationship with: 



Very satisfied ^ 
Somewhat utisfied 
Somewhat disutisfied *i 

TjATpiip Very dissatisfied n ( 

Parents and parent groups. . . , I^^- • ®®©<E) 

Fellow staff members 

Students 



W^. ■■ ®®©© 

TSATST ®<g)0© 



Mark the answtrt which bttt dticrib* your 
feehngs about the commtntt below: 



#1: TOAH 



#2-7: PERSAD 



#8-10: PERDAD 



t true -1 
rue-j 



Almost always true 
Usually true ^ 
Sometimes true 
Seldom true 
Almost never true 

J.fnioY classroom teaching , ©©O©© 

The administration in this school acts decisively on suggestions from the faculty. . ®©0©© 

The admintstration in this school supports the disciplinary measures of the teachers ®©0©© 

The administration in this school encourages classroom innovation with real, practical support . ®©0©© 

Fne administration in this school is concerned with real student progress as opposed to token programs 

which only appear to be progressive , ®©0©© 

Thp administration In this school is more concerned with real student progress than with quiet, orderly 

classrooms .®©©©© 

The administration in this school encourages teacher initiative in regard to new programs, as opposed to 

^ handing down decisions which the teachers then must carry out . . . ®® ©©© 

[the central administration of this district treats teachers as professional, contritMJting members of the staff . . .®® ©©© 
Teachers can expect support for their classroom policies from the central administration of this district, . . .®©0©© 
The central administration of this district is effective in developing realistic program goals ®©0©© 



I use it daily -| 
I use it weekly 
I use it monthly 



CLPRACT 

Here is a list of some classroom practices. For each practice 

mark the column which bast indicates your use of the practice _ _ ^ 

I do not use it 1 

Pupil participation in lesson planning .> ® ®©(S) 

Pupil participation in classroom teaching. ©d)©® 

Having pupils work m small learning teams . ®®©(S> 

Role playing (acting out situations) ®®©C>) 

Use of games to aid learning ©o©® 

Pupil evaluation of classroom climate ®®0© 

Pupil participation in developing classroom rules ®®©® 

Involving pupils in community projects ©o©© 

Utilizing local citizens as resource personnel .©©©(§) 

Pupils as helpers or tutors of other pupils ® ®©0 

Joint lesson planning with one or more teachers ©©©© 
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PERLERAT •: TPWPAR 



Surveys of school probkmi show a numbtr of thinp rtported by ttichtrt as rtduckif ith« tfftctivMifi of 
Itit school. Bolow is a partial list of th«M probltms. Mark Y {ym) for thc^ «ituatiofH tfstt c^mtlluta • 
proWtm in your school. Mark N iw) for thost ?.hat do iMit conttttutt a proUam in your sdiool. Yas^ 1 

-There is too much teacher turnover 0® 

-The classes are too large for effective teaching ® (H) 

*There are too many absences among students , , ® <S) 

*Pupils are not well fed and/or well clothed ®® 

-The different races or ethnic groups don't get along together ®<S) 

-There are too many interruptions during class periods 0® 

-Teachers have too little freedom in such matters as textbook selection and curriculum 0® 

^Parents attempt to interfere w»th the school .0® 

-There is too much coiTtpetlticn for grades 0® 

-There is too much emphasis on athletics ^ 0® 

-There should be a better mixture; the studenw a:e all too much of one type 0© 

-Too much time has to be spent on discipline ^ 0® 

^The parents put too much pressure on th3 students for good grades 0® 

-The students aren't really interested in ledrning 0® 

-There is a lack of effective leadership from the school administration 0® 

*The parents don't take enough interest m their children's schoolwork 0® 

-The teachers don't seem to be able to work welMogether 0® 

-We have poor instructional equipment: supplies, books, laboratory equipment, etc 0® 



TPET 



Please mark the response which best describes 
how you usually feel. 



of men 

Til 



Almost always true of me ^ 
Often true of me n 
Sometimes troe of me * 
SaMom true of ma 
Almost never true of me 

I feel that my ideas are considered worthwhile by my supervisors. ®<D©(§)(D 

I have a lot of influence with my colleagues on educational matters ® <§)©(§)© 

I have confidence in myself even when people disagree with me ®<D©(§)© 

I find it difficult to interact with others ® ©©©<§) 

I seem to be the kind of person who has more bad luck than good luck ® (D©®© 

I have trouble making up my mind about important decisions ® @©®© 

in my activities at school I am assertive and self-reliant ® ®©®© 

I don't take a position on sormthing until I find out what my colleagues think . .©©©©© 



mm 

I am a 

Male O 

Female O 



TEOUC 

Which of the following best deicrtbes your level of formal education? 

No degree. O 

Bachelor's degree .O 

Master's dedrae or equivalency O 

Master's defiree plus one year O 

Doctor's djgree O 



What is your average class 
size? (Exclude supervisory 
duties such as study halL) 

STAfFP 



<§)© 
G® 
<D® 
<D® 
<f)® 
<D® 
0)® 
®® 
<i>® 
(a)® 

II 



How many hours (to the 
nearest hour) are you 
assigned to clauroom 
instruction per week? 

HRPERWK 



® 


® 


0® 


(D® 


(D® 


®® 




® 




® 




@ 




® 




® 



1 1 



Including this yMr. how 
many yMn of tMching 
axpcrianca do you h«««? 



TEXPER 
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FOR SECONDARY ONLY 
How many diffiront courtss. 
on tha avwagt, do ynu 
tMch par day? 

PREPERDY 



® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
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